THE  VALIDITY  OF  OFFICER  EFFICIENCY 
REPORi;  WD  AGO  FOIW  67-1, 

FOR  GENERAL  OFFICERS 

PRS  REPORT  792 


FOREWORD:  PRS  reports  are  primarily  technical.  While 
conclusions  affecting  military  policy  or  operations  may 
appear  in  them,  they  are  net  Intended  as  a  has is  for  official 
action,  Flndln^ja  and  conclusions  contained  In  PRS  reports 
are  Intended  to  guide  the  conduct  of  further  research.  When 
research  findings  suggest  recommendations  for  adminlstratlYe 
action,  such  recommendations  are  mad.e  separately  to  the 
appropriate  military  agency. 
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THE  VALIDITY  OF  OFFICER  EFFIOIEWnY  BEPORT, 

WD  AGO  FOEM  67-1,  FOR  GENERAL  OFFICERS 
(Based  on  PIS  Report  792) 

BRIEF 

STATIMEKP  OF  EROBLHMi 

Past  research  has  Indicated  sufficient  Talldity  for  the  Officer 
Efficiency.  Report,  WD  AGO  Form  67-1,  to  .Justify  its  use  In  rating  Army 
officers  of  grades  from  lieutenant  through  colonel.  Can  it  he  shown  to  ho 
ralid  for  use  with  general  officers  as  well? 

RESULTS: 

.  i.  The  demonstrated  validities  for  Foim  67-1  in  rating  general 
officers  are  similar  to  validities  of  the  instrument  in  rating  officers  of 
grade  lower  than  general,  when  adjustmonts  are  made  for  difference  in  range 
of  scores  for  the  two  groups.  Against  two  dlffore»..t  criterion  measures,  the 
67-1  validities  were  and  .k6  for  hrlgadler  generals,  and  .39  nnd  .43  for 
major  generals. 

2.  The  vcOldltles  for  the  separate  parts  of  the  form  varied  as  much 
as  ten  points  among  themselves  hut  approximated  the  vellditles  of  the  same 
parts  for  officers  of  lower  grades . 

3.  Or  the  average  the  genereG.  officers  scored  suhstantially  higher 
on  the  instrument  than  other  officers. 

CORCLDEIOKS: 

Form  67-1  la  as  valid  in  estimating  the  efficiency  of  general 
officers  as  in  estimating  the  efficiency  of  lower  grade  officers. 

2.  The  general  scoring  methods  used  for  other  grades  of  officers 
are  usahle  for  general  officers  as  we3J.. 

WORE  SOMtARY; 

Each  Of  286  brigadier  and  major  geneirals  was  confidentially  rated 
on  his  value  as  an  officer  hy  twenty  hrlgadler  and  sia.Jor  generals  who  had 
indicated  Imowledge  of  hie  ahilitles.  The  ratings  they  received  hy  thi^ 
procedure  were  correlated  with  ratings  on  Fona  67-1  (a)  for  each  part  of 
the  form  separately  and  (h)  for  the  term  be  a  whole.  Optimal  scoring 
and  weightings  were  detezmined. 
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THE  VAUDITY  0?  OFFICER  SFFICIBJCY  102*01®, 
WD  AGO  FORM  67-1,  FOR  GESERAL  OFFICERS 


BACKGROUND 


-In  19^,  The  Adjutant  General's  Office  was  directed  to  study  efficiency 
rating  procedures  for  Army  Air  Ibrce  general  officers.—^  The  following  two 
rating  forms  were  coii5)ared:  (l)  the  eaq>erliiiental  Officer  Efficiency  Report, 
WD  AGO  Foim  67-1,  the  research  predecessor  of  the  currently  authorized 

WD  AGO  Form  67-1,  and  (2)  Officer  Evaluation  Report,  WD  iSGO  Form  6?,  a 
latter  form  of  rating  In  official  use  at  that  time.  General  officers  of 
the  Army  were  not  Included  In  the  study.  Analysis  of  the  letter  Form  67 
Indicated  that  It  failed  almost  completely  to  differentiate  general  off iceiTE 
in  the  two  la^Kjrtant  factors  considered.— manner  of  performance  and  profea- 
alonal  knowledge.  Even  on  the  small  sample  available.  Form  67-1  indicated 
adequate  differentiation  In  hoth  the  forced-clwice  and  over-ali  ratings 
and  agreed  with  the  criterfon  to  a  much  more  satisfactory  degree  than  did 
the  letter  Form  67.—^  Conclusions  were  of  necessity  qual^^ed  ^ecaiuje  of 
the  relatively  small  number  of  general  officers  for  whom  Forms  67-1  were 
available  at  that  time.  _  . 

When  Form  67-1  was  introduced  In  19^7  as  the  official  officer  ^tlng 
procedur’e.  It  was  thoxight  desirable  to  determine  the  appropriateness  of 

17  Authorizing  directives:  DF  from  Ac/S,  G-1,  WDGS,  to  TAG,  file  nuiAsf 
WDGAP  201.6  (2lt  Jul  45),  Subject:  Study  of  Off  leer  Efficiency  Ratl^ 
Methods,  dated  27  April  1946 J  Comment  No.  5  to  WD  Dlapositlph  Fom 
from  d/p  and  A,  WDGS,  to  TAG,  file  number  WDGPA  200  (15  Aug;  46),  SubjMt; 
Priority  of  Personnel  Research  Projects,  dated  2  !loT«id:er  1946. 

2/  PRS  Report  7^9,  Report  of  The  Validity  of  Two  Efficiency  Renftrtir^ 

Methods -Applied  to  AAF  Generals.  The  Adjutant  Genoiral  *8  Office, 

Personnel  Reseeaoh  Section,  7  January  1^8. 


tho  fcrsi  fcr  uss  vith  gsn.eral  offiears  of  tao  none  of  whom  had  Deen 

3  / 

Included  In  the  67-1  validation  and  acondardization  i,opulatlonB 
PROBJJSi 

T’r.<3  t:rlS5iT-&l  objectives  of  this  study  were:  (i)  bo  determliie  the 
validity  of  the  Officer  Efficiency  Report,  WD  AG^  Form  67-1?  fo^'  use  with 
general  officers;  (2)  to  study  the  comparative  validity  <?f  the  form  for 
general  officers  and  all  other  grades  of  offic'ra;  and  (3)  to  determine 
whether  the  conversion  nahleo  used  with  officers  of  the  grade  of  colonel 
and  below  may  be  utilized  for  officers  of  general,  grade. 

FOFOLATION 

The  limits  of  the  subject  population  were  set  by  AE  6OO-185  (27  May  hj) 
which  required  the  accomplishment  of  WD  AGO  Form  67-1  only  for  general 
officers  who  held  appointment  as  brigadier  gereral  or  were  In  the  temporary 
grade  of  major  general.  At  the  time  the  study  was  undertaken,  there  ’■«i8  a 
total  of  328  active  general  officers  below  the  rank  of  lieutenant  general — 
143  major  generals-^  and  l8^  brigadier  generals.  Although  the  strong 
possibility  existed  that  coiroleted  Officer  Efficiency  Reports  would  not 
be  available  for  a  large  number  of  the  major  generals  (l.e.,  for  tho>^o 
who  achieved  that  permanent  rank  prior  to  1  July  1947)?  It  was  decided  to 
include  all  major  generals  in  the  initial  phases  of  the  study. 

PRKDIOTOR  VARIABLES 

The  Officer  Efficiency  Report,  WD  .4GO  Form  67-1,  1  July  47,  is  the 
basic  instrument  with  which  this  study  is  concerned.  This  form  consists 
of  nine  sections.  Sections  I  and  II  con5>ri8e  Part  I  and  Sections  III 
through  K  coa^rlse  Part  II.  A  brief  description  of  the  sections 
concerned  with  actual  ratings  (as  against  those  calling  for  mere  back¬ 
ground  data)  is  presented  below. 

3/  Disposition  Form  from  d/p  and  A  to  TAG,  File  CSGPA  201.61,  Subject: 
Validation  of  WD  AGO  Form  67-*  1,  Officer  Efficiency  Report  for  Genere^ 
Officers,  dated  2  Aug  1948, 

4/  One  major  general  was  retired  shortly  after  the  beginning  of  the 
study,  reducing  the  number  of  major  generals  to  l42  and  the  total 
of  major  and  brigadier  generals  to  32?. 
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Section  II.  Data  and  Suggest  ions  for  Use  in  Asslgiaaent: 


il 

jTr 

ST- 


% 


A.  Duties  Actually  Performed  on  Present  Jol):  Calls  for  a  l)rlef 
desoription  by  the  rater  of  the  subject’s  current  Job  duties. 


B.  Description  of  Officer  Rated  and  Gomaants:  Provides  space  for 
comments  by  rating  officer  and  index’s ing  officer  regarding  the  ”phyBical, 
mantel,  and  moral  qualities  of  the  rated  officer,  specialties  of  value  to 
the  Army,  and  ai^  special  defects  or  veaknesses  affecting  his  ability  to 

do  certain  assignments." 

C.  Estimated  Desirability  In  Various  Capacities:  A  five-point 
rating  scale  which  represents  the  rater’s  and  Indorser’s  evaluations  of 
the  probable  suitability  of  the  ratee  In  various  hypothetical  Job 
capacities . 

Section  IV.  Job  Proficiency:  Twelve  forced-choice  tetrads  {k8  items) 
describing  desirable  and  undesirable  behavior  characteristics  affecting 
efficiency  of  Job  performance.  For  each  tetrad,  the  rater  is  asked  to 
indicate  which  phrase  is  most  descriptive  of  the  individual  rated  and 
which  phrase  la  least  descriptive. 

Section  V.  Job  Proficiency:  A  tea-point  ratisg  scale -for  rating  and 
Indorsing  officers  in  which  the  rater  is  asked  to  eveduate  the  subject’s 
over-all  Job  proflclenoy  to  one  or  tvo  of  aeVen  briefly  desertbod  ^eas. 
of  duty.  The  area  which  cortesponds  to  the  subject’s  principal  Job 
assignment  is  selected  as  his  "prlsaucy"  duty;  If  there  is  i^t-her  wea 
which  also  Is  descriptive  of  his  whk,  it  is  ter^i  his  "sTOohdary"  duty. 

Section  YI.  Personal  ^h^lificatipns :  Twelve  forcad^chplce  betrads; 

(48  it^as)  calling  for  <ai  ovali^tlcn  to  teraa  of  the  pes^onal  que^bies 
in  each  set  of  tetrads  which  are  most  descriptive  and  least  descriptive 
of  the  ratee. 

Section.  VH.  Personal  Quallficstions:  ;A  ten-point  scale  fer  »tl^^ 
and  indorsing  officers  which  required  eui  indlcatlbn  of  bhe  extent  fe>4whibh. 
the  ratee  poseesBss  six  described  traits.  J;V ~  ^ 

Only  Sections  IV,  V,  VI,  and  VII  of  Form  were:  Miedyz^  “  ^ 

current  Investigation,  inxese  are  the  a©ctioi«  eJslGyed-  to:  derivlr^  tlie 
final  numerical  score.  -  IL 

*  T  * 
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CRITERION  VARIABLES 


I 

I 


It  was  decided  that  ratings  by  peers  would  serve  as  the  independent 
yardsbioh  of  efficiency  against  which  the  Form  6T-1  could  he  validated 
for  general  officers.  For  this  pxirpose  the  Officer  Evaluation  Fom  OE-G 
(WD  A30;  PRT-676)  was  used,  Ti.  instrument  wa*"  initially  developed  for 
the  study  of  Aray  Air  Force  generals.  It  gives  each  rating  officer  the 
opportunl';y  to  express  hla  opinion  of  the  efficiency  of  those  fellow 
officers  of  general  grade  with  whose  work  he  is  most  familiar. 

The  Officer  Evaluation  Form  is  divided  into  two  parts.  In  Section  I, 

* 

the  rating  officer  is  asked  to  place  each  subject  in  an  appropriate 
position  on  a  SO-polnt  scale,  evaliiating  him  in  relation  to  all  Army  officers 
of  his  grade.  In  Section  II,  the  rater  is  asked  to  indicate  the  seven  most 
and  seven  least  conpetent  of  all  officers  ho  is  rating.  In  this  manner, 
the  study  was  designed  to  yield  two  criterion  ratings  on  each  rated  officer. 

PROCEDURE 

AiCcompliah-i-ng  Ratings  on  Form  OE~G 

Rosters  of  all  general  officers  were  obtained  from  the  General 
Ol'f leers’  Section  of  The  Adjutant  General's  Office.  Assignments  of  ell 
major  generals  and  brigadier  generals  :.ere  obtained  from  the  General 
Officers '  Section,  Career  Management  Group,  Division  of  Personnel  and 
Administration  from  which  separate  mimeographed  rosters  of  active  major 
generals  Jind  brigadier  generals  were  prepared. 

A  letter  was  sent  to  each  major  general  and  brigadier  general 
explaining  the  puz-pose  of  the  study  and  requesting  his  cooperation.  A 
mimeographed  roster  of  major  generals  or  brigadier  generals  (depending 
upon  grade  of  the  addressee)  was  inclosed.  The  addressee  was  aslrad  to 
check  the  names  of  the  individuals  with  whom  he  was  acquainted.  Of 
these  officers,  he  was  asked  to  indicate  at  least  hO  (if  possible) 
whose  work  he  knew  well  enough  to  rate. 

From  the  coii5)leted  rosters  returned  by  l40  major  generals 
(98.6^  of  the  base  population)  and  178  brigadier  generals  of  the 

base  population),  the  Officer  Evaluation  Form  OE-G  was  prepared,  first 
for  major  genercLls,  later  for  brigadier  generals.  Each  major  general 
was  asked  to  rate  on  Form  OE-G  a  maximum  of  20  officers  randomly  selected 
from  the  list  of  men  with  whose  work  he  had  Indicated  famillari'c'*.  An 
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atten^*^  vob  loads  to  Include  each  major  general's  name  on  20  lleta  in  order 
to  secure  20  ratings  per  man.  Officers  whose  names  were  checked  on  less 
than  six  of  the  original,  losters  were  excluded  as  subjects  of  the  study 4 
Moreover,  officers  who  had  indicated  familiarity  with  the  work  of  less 
than  12  other  officers  wefe  excluded  as  i'aters. 

Hetums  of  Forms  OE-G  by  major  generals  seamed  to  Indicate  some  con> 
fusion  in  regard  to  Section  I.  The  misinterpretation  apparently  arose  from 
the  use  of  20  names  on  the  list  with  20  places  on  the  scale.  To  preclude 
a  simileir  misinterpretation  by  brigadier  generals,  more  than  20  names  were 
included  in  the  Foma  OZ-G  prepared  for  them.  Otherwise  the  proced^e  for 
brigadier  generals  was  .exactly  as  described  above. 

Scoring  Eatings  from  Form  OE-G 

a.  In  Section  I,  a  subject's  score  for  each  OS-G  was  equivalent 
to  his  position  dh  the  20-polnt  scale  (a  score  of  20  representing  the 
maximum  obtainable  by  the  "best"  officer),  lAile  his  final  score  on 
Section  I  was  the  mean  of  all  such  scores  from  all  ratings  he  received. 

.  b.  In  Section  II  of  Form  OE-^G,  a  weighting  system  for  position 
as  one  of  the  seven  judged  most  conpeteht,  seven  le^t  competent,  or  inter-  - 
mediate  group  was  developed.  The  scale  of  weights  piovides  an  adjust^nt 
for  the  varying  number  of  men  evaluated  by  each  rater,  to  officer's  score 
on  Section  II  became  a  function  not  only  of  the  rank  position  of  his  judged 
competence,  but  of  the  total  number  of  men  evaluated  by  the  rater.  Wei^ts 
were  assigned  through  a  roxigh  application  of  the  npzmal  cvarre.  The 
assuoption  that  general  officer  ability  is  normally  distributed  required-^ 
that  a  certain  proportion  of  rated  officers  receive  each  of  the  possible 
scores .  When  only  15  officers  were  evaluated  by  a  slhglo  rater,  fewer  of 
them  received  the  maximum  score  of  four  than  when  25  officers  were  rated. 
Proportions  of  the  normal  curve  were  not  followed  rigorously,  .however, 
since  in  a  few  instances  in  was  deemed  advisable  to  create  more  of  a 
distinction  between  weights  for  different  numbers  of  ratees  than>wuld  bs 
possible  through  a  strict  application  of  the  noxm^  pu^e.  The  a^b  jept^'st 
final  rating  in  Section  II,  similarly  to  Section  I,  was  the:^to^^f 
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ratings  he  received  In  Section  II.-  The  eliding  scale  of  weights  used  In 
scoring  Section  II  is  shown  In  Table  1  below. 


Table  1 

SCOHING  WEIGHTS  FOR  POSITION  ON  NCHINATING  SCiJJE,  SECTION  II, 
OFFICER  mUJATION  REPORT,  OE-G 


Scale 

Number  of  Men  Rated 

Position 

24-25 

20-23 

17-19 

l4-i6 

13 

12 

% 

4 

4 

4 

4 

4 

4 

^2 

4 

4 

4 

4 

3 

3 

4 

3 

3 

3 

3. 

3 

3 

3 

3 

3 

3 

3 

=5 

3 

3 

3 

3 

*9 

2 

3 

3 

3 

2 

2 

2 

H., 

7 

3 

3 

2 

2 

2 

rJW- 

1 

1 

2 

2 

2 

- 

^6 

1 

1 

1 

2 

2 

2 

s 

X 

1 

1 

1 

2 

2 

1 

1 

1 

1 

1 

1 

"3 

0 

1 

1 

1 

1 

1 

I- 

0 

0 

0 

0 

1 

1 

0 

0 

0 

0 

0 

0 

Not 

Nominated 

2 

2 

2 

2 

2 

- 

*  H  =  High 

**  I.  =  Low 

Obtaining  and  Selecting  Forms  6T-1 

Efficiency  Reports,  WD  AGO  Form  67-1,  i^lch  had  been  con5)lotod  on 
all  general  officers  from  the  time,  the  form  was  authorized  for  official  use 
(l  July  hj)  to  the  time  the  statistical  analyses  were  oon5)leted,  were  obtained 
from  the  Career  Management  Branch  of  the  Division  of  Persoime]  and  Adminis¬ 
tration  and  from  the  Personnel  Infoimation  Branch  of  The  Adjutant  General’s 
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Office,  yhere  Parte  I  and  II,  respeotlTe3-y,  cf  Form  67-1  were  filed.  XJaatle 
Forma  67-1  were  awallable  for  ll6  major  generale  (81.7^  of  the  'oeae  populatlciiy 
and  173  ‘brigadier  generals  (93*5i)t  of  the  base  population). 

One  Fom  67-1  vaa  selected  for  each  subject.  Criteria  for  selection 
of  these  r-jporta  were:  (l)  a  minimum  of  90  days  for  period  powered  by  report, 
and  (2)  where  tsore  than  one  Form  67-1  existed  for  a  ratee,  most  lutlmate 
vorldng  contact  between  ratee  and  rater  (as  indicated  by  Section  II  X  of 
the  Foma). 

Processing  Pate 

The  following  data  were  coded  and  punched: 

# 

General 
Eanh 

Man  number 
Form  0E-* 

Bating  (single  and  mean)  on  20>point  scale  (Section  I) 

Eating  (single  and  mean)  via  nominating  technlq[ito  (Section  II) 

Number  of  raters  on  26-poiht  scale 
Number  of  raters  Tla  wminating  technique 

Form  67-I 

Date  of  Beport  c  / 

Job  Proficiency  (JP)  Eaw  Score^^  5/ 

Personal  Qnalif  icstions.CPQ)  Baw  Scored' 

Orer-All  (-OA)  Baw  Scored' 

Section  II  Part  C  -  Eater  (Baw  score  for  each  sc^e) 

Section  II  Part  C  >  Dindorser  (Baw  score  for  each  scale) 

Section  IF  Baw  Score 
Section  V  -  Primary  Duty  "  Eater 
Section  V  -  Secondrucy  Duty  -  Eater  g  / 

Section  V  -  Primary  Duty  -  Indorser^' r/ 

Section  y  -  Seconds^  Ihity  -  Indorser^' 

Section  ‘FI  -  Eaw  Score 

Section  "FII  -  Personal  Qualifications  -  Eater  g j 
Section  FlI  -  Personal  Qualifications  -  Indorser^' 

STATISTICAL  ANALYSES  j 

I 

The  following  yarlables  were  intercorrelated  for  major  and  brlgadief  | 


ed 


5/  By  scoring  syr-tem  in  effect  1  July  19^7  to  April  19^9*  Sliw.e  use  of  -tMs 
~  score  was  discontinued  prior  to  the  con^letlon  of  this  stu^,  it  is  not 
considered  in  the  analysis. 

6/  So  few  reports  on  the  generals  ^ose  Forms  67-1  were  studied  in  this 

project  bore  Indorsements  that  no  atten^t  was  made  to  study  these  warlables . 
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generals  conBldarad  as  a  group  and  for  major  gonoralo  and  ‘brigadier  generals 


VM.  laiV^Ckk  C^V0X^  • 


A.  Form  OS-G 


1.  Mean  ratings  on  20-point  soale 

2.  Mean  ratings  ria  nominating  technique 

B.  WB  AJO  Form  67-1 

3.  Section  IV  Saw  Scores 

4.  Section  V  -  Primary  Duty  -  Batirg  officer 
3.  Section  '71  Bav  Scores 

6.  Section  7II  -  Bav  scores  of  each  of  the  six  scales  - 
Eating  officer 

C.  Means  and  standard  deriations  of  these  variahles  vere  also 


CGsqtuted. 


B.  A  frequency  distrihution  of  moan  ratings  on  the  criterion 


vas  made. 


1. 

F. 


T  ’ 

The  reliability  of  the  criterion  vas  eatlmatede— ^ 


8/ 


Sigma  distances  of  mean  orer-eOJ.  Form  67-1  standard  scores—' 


of  general  officers  ahoro  the  mean  oyer-all  standard  scores— ^  of  all  other 
grades  of  officers  vere  conqinted.  This  vas  accoB^Ushed  in  order  to  proride 
Information  'bearing  on  the  applicahility  to  gezieral  officers  of  the 
conrersion  table  deyeloped  for  use  vith  lover-grade  officers . 

G,  A  coefficient  of  correlation  vas  obtained  hetveen  the  i^ber 
of  times  the  rated  officer's  name  vas  checlrad  off  on  the  original  rosters 
and  the  rating  he  recelred.  This  vas  isne  to  determine  Aether  or  not  a 
relationship  exists  hetveen  villingness  to  rate  an  officer  and  the  rating 


he  receives. 


7/  tTslng  Horst's  formula,  r  11  ^1 


E 


n--l 


Nc, 


%  See  Horst,  Paul.  A  Generalized 


M 


Bcpresalon  for  the  Eeliabllity  of  Measures  Psychometrika,  19^9,  1^,  21-32. 

8/  Those  scores  vere  coa5)Utea  by  use  of  the  revised  scorltsg  veights  developed 
itader  PJ  hl0h-08,  19^9,  FollOv-up  Validation  of  Form  67-1  (PBS  Beport 
Ho .  791) .  Ihls  scoring  system  replcusod  the  scoring  procedure  in  effect 
1  July  kj  to  April  t9.  Under  the  revised  plan,  separate  scores  for  Job 
profiolenoy  and  personal  qualifications  have  been  abandoned  for  a  single 
i  over-all.  score,  vhlch  is  not  the  same  as  the  former  over-all  score. 
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general  offloere  considered  as  part  of  the  total  officer  population,  a 
fozttula  for  correction  for  restriction  In  range  was  applied. 


I.  Multiple  correlations  and  heta  weights  were  obtained  for  the 
prediction  of  each  of  the  two  criteria  from  the  best  weighted  cooiblzuitlon 
of  Sections  17  -  VII  of  Form  67-I.  The  Talidlty  of  the  form  when  peurts 
were  combined  by  straight  addition  and  when  the  scoring  fonnula  dereloped  , 
under  PJ  4l04~’08  was  applied  was  also  detezmined. 

BESUITS 


On  the  basis  of  findings  of  past  reliability  studies,  it  was  decided 
to  exclude  from  the  analysis  of  data  any  subject  who  had  been  eraluated  by 
less  than  five  fellow  officers  on  Form  OE-G.  This  eliminated  only  five 
general  officers .  Of  the  remaining  number.  Forma  67>1  ware  available  for 
116  major  genereds  (82j(  of  base  population)  and  17O  brigadier  generals 
(92j(  of  base  population),  making  a  total  of  286  usable  oases  for  this 
investigation. 


Table  2  shows  the  distribution  of  number  of  ratings  for  all  general 
officers  on  whom  criterion  evaluations  were  feoelved.  The  mean  ni^ef  :of 
ratings  is  l4.5. 

Table  2 

DISTBIBUriON  OF  HUMBER  OF  RECEIVED  BI  GERSRAL  OFFICE^ 

EFALUATSD  ON  FOIM  OE-G 


Number  of  Number  of  Men. 

Eatings  Receiving  Ratios 


1-5 

3 

h  .6 

9 

7-9 

17 

10  -  12 

56 

15  -  15 

13.3 

16  -  18 

75 

19  -  21 

5lf 

S  and  up 

.15 

Total 

wr 

A  sampling  bias  which  might  tend  to  reduce  the  site  of  i^e  vaUdlty 
coefficient  entered  into  the  population  of  major  generals,  since  Forms  67'^i 


f 


i 
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are  not  accon^illshed  for  general  officers  in  the  permanent  grade  of  major 
general.  As  a  poasihle  effect  of  this,  the  superior  segment  of  major 
generals  —  those  promoted  to  permanent  status  —  may  haye  heen  absent  from 
the  study,  with  a  consequent  narroving  of  the  range  of  population. 

Predictor  Variables 

Because  of  the  restricted  nature  of  the  sanqjle  (officers  of  rery 
hi^  rank),  it  was  anticipated,  and  later  substantiated  by  the  data,  that 
means  would  be  high  and  standard  derlations  low.  On  all  parts  of  "Uie 
Form  67-1,  the  moan  score  for  general  officers  was  above  the  average  scores 
of  field  and  con^jany  grade  officers,  and  the  stand^d  deviation  considerably 
below. 

The  mean  over-all  standard  score  for  brigadier  generals  was  131,  for 
9/ 

uajor  generals  133.—  Both  are  substantially  hl^er  than  mean  over-all 
standard  scores  of  a  combined  population  of  BA  and  non-regular  lower  grade 
officers.  The  iq)ward  deviation  of  general  officer  scores  is  lass  pronounced 
when  the  general  officers  are  con5>arod  with  SA  officers  alone.  Table  3 
shows  the  mean  over-all  standard  scores  by  grade  for  10,000  regular  Azmy 
officers  below  the  grade  of  general  and  for  286  brigadier  and  major  generals. 
The  standard  scores  are  based  on  Form  67-1  scores  of  the  10,000  lower  grade 
officers . 

Table  3 

MEAN  OVER-ALL  STANBlABD  SCOEES  WD  AOO  k}iM  67-1  FOB 
10,000  BA  OFFICERS  OF  GRADES  USOTIQIAST 
TBROBGH  COLONEL  AND  FOB  286  BRIGADIER 
AND  MAJOR  GENERALS* 


- 

- 

Grade 

Standard  Score 

Major  General 

133* 

Brigadier  General 

131 

-= 

Colonel 

113 

-  Lt.  Colonel 

112 

Major 

109 

Captain 

107 

let  Lieutenant 

105 

2nd  Lieutenant 

81 

* 

*  Stendard  Scores  are  obtained  from  ^he  official  Armj  conversion 
table  of  April  1S>49. 


s  ' 

9/  By  revised  scoring  system  of  ?J  4l04-08. 
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For  the  2o6  generai.  officers  in  the  final  pheiae  of  the  study,  fables 
4,  5,  and  6  shov  the  m’^ans,  standard  deriatlone,  and  Intercorrelations 
among  the  folloving  Form  6.7'1  rav  scores: 

1.  Seotion  17  -  Job  Perforaanoe  -  Forced-choice  tetrads 

2.  Seotion  7  -  Job  Performance  Rating  officer  -  Primary  duty 
5.  Seotion  Vi  -  Personal  Qualifications  -  Forced-choice  tetrads 
4.  Seotion  7II  -  Personal  Qualifications  -  Rating  officer 

(six  scales) 


Table  4 

2H?ESCOHE23:JiTI(W,  OF  WD  ACC  POiM  Sj^l  RAW  SC0H85  FOR 
MAJOR  A3SD  ^BIl^GAn^Ei  CSaSiAIS 

K»2a6 


Maa& 

S.b. 

ForBi  67-1  Variable 

---  -  -  -  - 

48.6 

3.28 

Sec.  17  -  Job  Proficiency 

- 

-  . 

Forcod-Cboice  Tetrads 

11 

’ 

9.2 

.89 

Sec.  7  -  Job  Proficiency 

, 

Rating  Scales 

2  .46  2 

46.4 

4.14 

Sec .  71  -  Personal  Qualifications 

Forced-Chcice  Tetrads 

3  .65  .49  3 

9.2 

.85 

Sec.  7II-  Personal  Qiallficatlons 

Rating  Scale  (1) 

4  .27  .68  ,.42  4 

9.4 

.76 

Sec.  7TI-  Personal  Qualifications 

Rating  ^ale  (2) 

5  .33  -6l  .54  .66  5 

9.5 

.79 

Sec.  7tl-  Personal  Qualifications 

- 

Rating  Scale  (3) 

6  .60  .68  .51  .45  .45 

6 

9-3 

.82 

Sec .  7II-  Personal  Qualifications 

-  ' 

BatlngrScale  (4) 

7  .34  .72  .36  .66  .59 

.66 

7 

9.2 

.84 

Sec.  7II>  Personal  Qualifications 

Hating  Scale  (5) 

8  .39  .61  .54  .58  .60 

.52 

.59  8 

9.6 

.71 

Sec.  VII-  Personal  (Qualifications 

Eatlbg  Scale  (6) 

9  .38  .68  .38  .53 

.73 

.68  .54  9 

4 


Table  5 

IKTERCOHifflLATIOH  OF  Vb  mO  FORM  67-1  RAW  SCORES  FOR 


MAJOR  GENERALS 
N=116 


Mean 

S.D. 

Fora  67-1  Variables 

1 

1*9.0 

2.80 

Sec.  rv  -  Job  Proficiency 

Forced-Choice  Tetrads 

1  1 

’^1 

9.1* 

.80 

Sec.  V  -  Job  Proficiency 

- 

Rating  Sca3.es 

2  .29 

2 

¥~ 

1»6.6 

5.82* 

Sec.  VI  -  Personal  Qualifications 

.56  5 

Forced-Choice  Tetrads 

5  -50 

9.2 

.78 

Sec.  I'll-  Personal  Qualifications 

S' 

Ratliag  Scale  (1) 

4  .27 

.65  .46 

4 

F 

9-5 

.62 

Sec.  TII-  Personal  Qualifications 

f 

Ratliig  Scale  (2) 

5  .04 

.55  .41 

.55 

5 

9.6 

.70 

Sec.  VII-  Personal  Qualifications 

Rating  Scale  (5) 

6  .59 

.71  .29 

.42 

.27  6 

9.1* 

.75 

Sec.  VII-  Peiraonal  Qualifications 

Rating  Scale  {4) 

7  -27 

.70  .28 

.62 

.40  .68  7 

F 

9.5 

.80 

Sec.  VII-  Personal  Qualifications 

.55  .52  .54 

8 

Rating  Scale  (5) 

8  .20 

.64-  .50 

.59 

9.6 

.70 

Sec.  VII-  Personal  Qualifloatl''n5 

.31  .72  .64 

,44 

Eating  Scale  (6) 

9  .55 

.61  .27 

.49 

9 

'i 

Table  6 

S; 

IHTKHCORRELAPIOS  OF  HD  AGO  FORM  67-1  RAH  SCORES  FOR 

1. 

BRIGADIER  GEIfERADS 

"S'. 

H=170 

Kean 

S.D. 

Fora  67-3.  Variables 

X' 

U8.4 

5.55 

Sec-  IV  -  Job  Proficiency 

-s 

Forced-Choice  Tetrads 

1  1 

9.2 

.95 

Sec.  V  Job  Proficiency 

2  .54 

s  * 

Rating  Scales 

2 

% 

1*6.2 

2*. 52 

Sec.  VI  -  Personal  Qualifications 

.56  5 

& 

Forced-Choice  Tetrads 

5  .72 

4--- 

9.1 

.89 

Sec.  VII-  Personal  Qualifications 

Rating  Scale  (l) 

4  .26 

.69  .40 

4 

9.5 

.85 

Sec.  VII-  Personal  Qualifications 

Rating  Scale  (2) 

5  .44 

.65  .59 

-71 

5 

r 

9.1* 

.84 

Sec.  VII-  Personal  Qualifications 

-S’ 

Rating  Scale  (?) 

6  .69 

.65  .62 

.46 

.51  6 

9.2 

.85 

Sec.  VII-  Personal  Q!;^lflcatloDS 

.68 

.67  .64  7 

Ratxng  Scale  (4) 

7  .56 

.75  .40 

9.1 

.85 

Sec.  VII-  Personal  Qualifications 

.63  .50  .61 

8 

.t- 

Bating  Scale  .(5) 

8  .48 

.58  .67 

.57 

- 

9.5 

.72 

Sec.  VII-  Personal  Qualifications 

.60 

r 

Rating  Scale  (6) 

9  .59 

.71  .45 

.57 

.64  .74  .‘71 

9 

i; 
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Criterion  v^iaolee 


Form  OE-G  proved  highly  euccefisful  In  producing  good  differehtlatlon 
among  general  officers.  On  the  20-polnt  scale  of  Section  I,  the  mean  score 
for  all  general  officers  in  the  saa^le  was  11.5.  The  mean  of  Section  II> 
which  has  a  max1m\3m  score  of  h,  was  1.5.  Table  7  below  presents,  for  major 
and  brigadier  generals  separately  and  for  the  combined  population,  the 
distribution  of  mean  scores  on  the  criterion  measures. 

Table  7 

DISTiJISITriON  OF  MKAK  RATIHGS  FOR  CRITERION  DATA  (FOHi  OE-G) 


- 

Section  I 
Mean 
Rating 

Frequency 

Major 

General 

Frequency 

Brigadier 

General 

Total 

Frequency 

Cumulative 

Frequency 

18 

2 

2 

2 

17 

3 

3 

6 

8 

16 

3 

10 

13 

2i 

15 

11 

l6 

27 

48 

14 

16 

16 

32 

80 

13 

13 

21 

34 

.114 

12 

16 

27 

43 

157 

11 

10 

13 

23 

l80 

10 

11 

13 

24 

204 

9 

13 

15 

28 

252 

8 

9 

16 

25 

257 

7 

6 

13 

19 

276 

6 

2 

3 

5 

28l 

5 

1 

1 

282 

4 

1 

2* 

284 

3 

1 

1 

285 

2 

— 

— 

'«»«» 

285 

1 

— 

1 

1 

286 

Mean  of  Mean 

Ratings 

11.7 

11.4 

11.5 

S.D. 

2.9 

3.1 

5.0 

Section  II 

3 

7 

12 

19 

19 

2 

55 

78 

153 

152 

1 

50 

68 

118 

270 

Mean  of  Mean 

Ratings 

1.6 

1.5 

1.5 

s.p. 

0.7 

0.7 

0.7 

* 

OZX  ?Oxtu  uduueu.  'tu  pxaco  (/I10  JTttl^SCL  OXXXOOX'  IQ  T/il9  882210 

rolativo  poaltion  In  "bcth  Sections  I  and  II  —  the  correlation  hotween  the 
tvo  sections  was  .88.  Eaters  agreed  w-th  each  other  ahnost  as  wall.  The 
estimated  rellahlllty  of  the  criterion  measures  for  the  comhined  population 
of  brigadier  and  major  generals  with  five  or  more  criterion  ratings  (l.e., 
322  officers)  was  .81  for  Section  I  and  .82  for  Section  II.  For  brigadier 
generals  alone,  reliabilities  were  .82  and  .81,  and  for  major  generals  .8l 
and  .83.—/ 

An  interesting  f Indli^  of  the  study  concerns  the  existence  of  a 
low  but  significant  and  positive  relationship  between  the  nusiber  of  times 
the  rated  officer's  name  was  checked  off  on  the  original  mimeographed 
rosters  sent  out  to  all  active  brigadier  and  major  generals  and  the  rating 
he  received  on  Fona  OE-G.  The  coefficient  of  correlation  between  nuniber 
of  times  mentioned  ai^  mean  individual  score  on  Section  I  of  Form  QE-G  was 
.29,  between  times  mentioned  and  Section  II  of  the  form,  .35.  This 
relatloMhlp  of  number  of  raters  able  and/or  willing  to  rate  to  mean 
rating  received  has  been  found  in  a  nuaibor  of  other  studios.  This 
finding  has  la^iortant  Ixi^licatlons  fc:*  piaiming  of  research  Invoxviiig 
ratings. 

Validity  of  the  Foim  67~1  For  General  Officers 

'Dependiiig  upon  which  system  is  used  for  weightiicg  parts  of  the 
Fom,  over-all  validities  of  the  Form  67-1  foi'. general  officers  zmnge  from 
.21  to  .44.  In  Tablo  8  below,  it  can  be  seen  that  the  maTlmum  total 
validities  obtainable  by  an  optliual  weighting  of  parts  of  the  Form  67-1 
are  .40  (multiple  E  with  OE-G  Section  I  criterion)  and  ,44  (multiple  S 
with  OE-G  Section  II  criterion)  for  the  population  of  brigadier  generals. 
Con5)arable  validities  for  major  generals  are  .38  and  ,40,  respectively. 

By  straight  summation  of  parts  of  the  Form,  validities  are  .37  and  .31 
for  brigadier  generals,  .28  and  .29  for  major  generals.  By  still  a  third 
scoring  system, — ^wei^tlng  of  parts  in  accordance  with  the  scoring  formula 
developed  in  PJ  4l04-08  —  over-all  validities  of  the  form  are  .33  and  .32 
for  brigadier  generals,  ,21  and  .24  for  aajor  generals. 

10/  Heliability  estlaated  by  Horst  formula:  see  note  7  on  page  12. 
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Table  8 

OVER.ALL  VALIDITY  OF  THE  F05H  67-1  FOR  SERERAL  OIFICEES 


Type  of  Weighting  for 
Total  Score 


Optimal  W^ei^tlng  (Maximum 
Multiple  R) 

Straight  Summation  of  Parts 

Official  Scoring  Weights  of 
PJ  41G4-08 


Correlation:  vith  Fora  01^-ir 
Major  Generals  Brigadier  Generals 


Seo.  I  Sec.  II  Sec.  I  Sec.  II 


IndlT.ldual  section  yalidities  of  Form  67-1  are  satisfactory.  An 
Inspection  of  Table  9  below  reveals  coefficients  of  correlation  with  the  two 
criterion  scales  of  Form  OE-G  as  high  as  .38. 

Table  9 

PART  SCORE  VALIDITY  OF  THE  WD  AGO  FORM  67-1  FOR  GESSRAL  OFFICERS 


Foot  67-I  Variables 


Sec.  IV  raw  score 
Sec .  V  Primary-  Duty 
Bat.  Off.- 
Sec,  VI  raw  score 
Seo.  VII  Eating 

Officer  1 
Sec.  VH  Bating 
Officer  2 
Sec.  VH  Eating 

Officer  3 
Sec.  Vn  Bating 

Officer  h 
Sec.  VII  Eating 

Officer  5 
Sec.  VII  Eating 

Officer  6 


Correlation  with  Form  OB-G 


jor  and  Brigadier 
•Major  General  Brigadier  General  General  J 

Sec. I  Sec.H  Sec. I  .'Sec.H'  Sec.I  '  Sec.Tt 


From  Table  9  it  can  be  seen  that  Section  IV,  Job'?p8rfprBai^  . tetrads, 
shows  the  greatest  validity  for  major  generals,  wiille  the  scales  of  STOtlon  VII, 
Personal  Qualifications,  show  the  greatest  validity  for  brigadier  generala. 
Sections  VI  and  VII,  Personal  Qualifications  tetrads  and  scales,  are  least  valid 


ror  3iaJor  generals.  In  conaidering  the  size  of  the  coefficients,  it  must 
he  reffiembered  that  the  population  is  itself  a  restricted  one,  representing 
top  level  officer  personnel.  Since  the  size  of  the  coefficient  of 
correlation  is  in  part  a  function  of  the  spread  of  scoi’es,  the  restricted 
population  plays  an  important  role  in  limiting  the  size  of  the  coefficients. 
An  e:caii»le  of  the  piling  up  of  scores  at  one  end  of  the  continuum  is  found 
in  Section  Til  in  vhlch  the  mean  score  of  each  of  the  six  scales  is  veil 
over  9  vhei-e  the  maximum  posalhle  score  is  10. 

When  the  general  officer  population  is  considered  as  the  i^per 
end  of  the  total  Amy  officer  population,  a  fomula  for  correction  of 
restricted  range  can  he  applied  vith  suhatantial  increase  in  validity.  Table 
10  shows  the  effect  on  validity  of  the  application  of  such  a  formula 

Table  10 

EFFECT  OF  CORRECTION  FOR  RESTRICTION  IN  RANGE  ON  7ALID1TY  OF 
F0»i  67'1  for  brigadier  and  MAJOR  GENERALS 


A. 


B. 


Fom  67-1  Score 

Section  I 

-  OE-G 

Section  II 

-  OE-G 

Uncorrected 

Corrected 

thaoorrected 

Corrected 

Major  Generals: 

Over -all 

r 

r 

r 

r 

.21 

.39 

.24 

.43 

Sec .  17 

.51 

.35 

.50 

Sec.  7  -  Prim.  Duty 
Rat.  Off. 

.29 

.45 

.26 

.40 

Sec.  71 

•  .15 

.17 

.11 

.15 

Sec.  VII  -  Rat.  Off. 

.18 

.29 

.20 

.31 

Brigadier  Generals: 

0ver-8ill 

.55 

CO 

• 

.32 

.46 

Section  17 

?21 

.26 

.13 

.16 

Sec.  7  -  Prim.  Duty 
Rat .  Off . 

.29 

.40 

.23 

.32 

Sec.  71 

.27 

.31 

.19 

,22 

Sec.  7II  -  Rat.  Off. 

.53 

.44 

.28 

.38 

11/  The  f ollovlng  fomula  of  Karl  Pearson,  which  zBalcea  S 

the  assumptibn  t^t  all  variables  studied  are  r.n 

nomally  distributed,  was  esployed;  -a  _  ^  "l 

12 

Where  is  the  S.D.  la  the  general  population  and 
Sj^  is  the  S.D.  in  the  restricted  population. 
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Data  bearing  on  the  validity  of  the  foiia  for  officers  other 
than  those  of  general  grade  were  gathered  in  Jonua:^  19^9  under  PR  4l0lt, 

12/ 

Study  of  Officer  Efflbienoy  Sating  Methods, — '  It  is  not  the  present  pinrpose 
to  report  in  detail  results  of  this  invest igatlon^  hut  merely  to  main  sbiw 
indication  of  the  relative  efficiency  of  the  functibhlng  of  Form  67-1 
officers  of  general  and  lover  gredds.  Figures  1  tl^ugh  ^  (pages  23-^); 
show  graphically  the  results  of  such  a  conparlson  for  over-all  sccrM  ar^ 
for  four  sections  of  Form  67-1:  Section  17,  V  (primary 'duty,  rating  off Icor) 
VI,  and  VH  (rating  officer) .  The  general  offlcew  are  oonpared  with 
Begular  Araj  officers  only. 


12/  These  data  are  presented  in  PBS  Report  791ai#.  19^9>  Fpllow-v^  7al4*iation 
of  VD  ASO  Form  67-lj  The  Adjutant  General's  Office,  Personnel  Besp^ch 
Section, 


GRABS 


1st  LtS. 
and  Capts. 


Ma^rs 


Li.coiB. 


LB>I1IB: 


TJols.  iJrig.Gsns.  Major  * 
Validity  of  Form  67-1  • 

liicreaae  -In  Validity  Resulting 
From  Correction  for  Restriction 
in  Range. 


Fig.  1.  Analysis  by  grade  of  the  ralldity  of  KB  AGO  Fora  6?-!,  Efficiency 
Report  for  Aray  Officers:  Orer-all  Score  deri/ed  from  PJ  4l04-08 
official  veldts.  (Criterion;  For  general  officers  -  PRF-676 
Section  I.  For  all  other  grades:  Ear-l629B.) 


let  Lts .  Majors 

and  Capte. 


Lt.Cols. 


Coli> 


Ma^r 

Gans. 


Fl«.  2. 


Brig 

Gsns 


QRADB 

i^nalysls  "by  grade  of  ■Ui.e  raildity  of  HD  AQO  Foxa  67-1,  Iffiolj^y 
Boport  for  Anay  Officers;  :Seotloa  17  -  JoB  Perfoxaaiwa,  ibrped* 
Choice  Tetrads .  (Criterion:  Ibr  general  officers  -  POT -676, 
Section  I.  For  ail  other  grades;  POT-2629B.) 


lat  I.t0 .  Majors 
and  Capts. 


GRADE 


Fig.  3.  Aaalyalo,l>y  grade  of  the  ralldity  of  WD  AGO  Form  67-1,  Efficiency 
Report  for  Army  Officers;  Section  V  -  Joh  Performance,  Primary 
Duty  Rater.  (Criterion;  For  general  officers  -  PIRr-676, 

Section  I.  For  all  other  grades;  PRT -16293.) 
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Analysis  by  grade  of  the  Talldity  of  WD  AGO  Form  67-1,  Efficiency 
Report  for  Army  Officers:  Section  VI  -  Personal  Qualifications, 
Forced-Choice  Tetrads.  (Criterion:  For  general  officers  - 
PRr-676,  Section  I.  For  all  other  grades:  PIir-l629B.) 
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Fig.  5.  Analysis  By  grade  of  the  yalidlty  of  V®  AGO  Fom  67-1,  Bfflclency 
Report  for  Army  Officers:  Section  VII  -  Personal  Qualifications, 
Rating  Officer.  (Criterion:  For  general  officers  -  PFT-676, 
Section  I.  For  all  other  grades:  PRIP-I629B.) 


Froui  Figures  1  through.  5  it  eau  be  aeen  that  validity  coefficients  for 
general  officers  compare  favorably  with  those  for  officers  of  other  grades, 
particularly  first  lieutenant,  captain,  and  major.  In  three  of  the  four 
sections  analyzed,  general  officer  validity  coefficients  equalled  or  exceeded 
those  for  the  three  lowest  grades  of  officers.  Only  in  Section  V  (job 
Proficiency)  of  Form  67-1  does  the  validity  for  general  officers  fall 
noticeably  below  that  for  other  grades  of  officers.^  In  every  Instance, 
validity  coefficients  for  lieutenant  colonels  and  colonels  exceed  to  a 
small  degree  those  of  general  officers. 

That  differences  in  validity  of  the  Form  67-1  for  general  officers  and 
lower  grade  officers  are  slight  and  may  be  due  at  least  in  part  to  greater 
range  of  scores  in  the  lower  grades  is  demonstrated  by  Figure  1  (Page  22) 
which  shows  the  effect  on  validity  of  correction  for  restriction  in  range. 
From  Figure  1,  it  la  seen  that  when  a  correction  for  smaller  variability  of 
general  officer  scores  is  applied,  the  difference  between  general  officer 
and  lower  grade  validities  becomes  very  slight  Indeed. 

In  interpreting  the  comparative  figures,  it  must  be  remembered  that  a 
different  criterion  Instrument  was  used  in  each  of  the  two  studies,  and 
since  the  size  of  the  validity  coefficient  is  in  part  a  function  of  the 
quality  of  the  criterion,  this  limitation  to  a  direct  coii5>ariso.n  of  grades 
should  be  borne  in  mind. 

CONCLOSIONS 

A.  The  corrected  multiple  K’s  of  .48  for  brigadier  generals  and  .39 
for  major  generals  obtained  throu^  use  of  the  official  scoring  formula  for 
lower  grade  officers  indicate  a  level  of  validity  that  renders  the  use  of 
WD  AGO  Form  67-1  desirable  as  an  estimate  of  general  officer  efficiency. 

B.  While  Section  VI  of  the  Form  67-1  shows  relatively  low  validity  for 
both  brigadier  and  major  generals  and  Section  VII  low  validity  for  major 
generals,  these  sections  are  valuable  because  of  the  contribution  they  make 
to  a. well-roxmded  picture  of  the  general  officer’s  abilities. 

C .  The  conversion  table  ^Ich  is  used  in  translating  raw  to  standard 
scores  for  all  other  grades  of  Army  officers  is  appropriate  for  general 
officers.  Its  continued  use  has  the 'following,  advantages; 


(1)  The  aaaunrotion  that  generals  issrsly  represent  the  upper-  end  of 
a  single  continuum  of  Army  officer  ability  is  probably  not  an  unwarranted  one 
and  seems  to  be  substantiated  by  the  data,  particularly  mean  differences  by 
grade  of  Form  67-1  scores.  Steady  increases  in  mean  67-I  scores  by  grade 
serve  to  support  the  statistical  findings  of  good  validity  of  the  form  and 
Justify  the  use  of  a  single  conversion  table  for  all  grades. 

(2)  There  la  la  wide  enough  range  of  ability  within  the  population 
of  general  of^'icers  so  that  the  advantage  of  being  able  to  conpare  general 
officers  with  each  other  is  still  retalr-’d. 

(3)  Not  only  would  it  be  possible  to  compare  general  offloers 
with  'each  other  but  in  addition,  direct  comparison  of  other  grades  of 
officers  with  general  officers  could  also  be  made. 
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